Few-Shot Learning With Class Imbalance

نویسندگان

چکیده

Few-Shot Learning (FSL) algorithms are commonly trained through Meta-Learning (ML), which exposes models to batches of tasks sampled from a meta-dataset mimic seen during evaluation. However, the standard training procedures overlook real-world dynamics where classes occur at different frequencies. While it is generally understood that class imbalance harms performance supervised methods, limited research examines impact on FSL evaluation task. Our analysis compares 10 state-of-the-art meta-learning and methods distributions rebalancing techniques. results reveal 1) some display natural disposition against while most other approaches produce drop by up 17% compared balanced task without appropriate mitigation; 2) many will not automatically learn balance exposure imbalanced tasks; 3) classical strategies, such as random oversampling, can still be very effective, leading performances should overlooked.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Few-shot Learning

Though deep neural networks have shown great success in the large data domain, they generally perform poorly on few-shot learning tasks, where a classifier has to quickly generalize after seeing very few examples from each class. The general belief is that gradient-based optimization in high capacity classifiers requires many iterative steps over many examples to perform well. Here, we propose ...

متن کامل

Few-Shot Learning with Graph Neural Networks

We propose to study the problem of few-shot learning with the prism of inference on a partially observed graphical model, constructed from a collection of input images whose label can be either observed or not. By assimilating generic message-passing inference algorithms with their neural-network counterparts, we define a graph neural network architecture that generalizes several of the recentl...

متن کامل

Few-Shot Learning with Meta Metric Learners

Existing few-shot learning approaches are based on either meta-learning or metriclearning, which would suffer if the tasks have varying numbers of classes and/or the tasks diverge significantly. We propose meta metric learning to deal with the limitations of the existing few-shot learning approaches. Our meta metric learning approach consists of two components, task-specific learners that explo...

متن کامل

Class Imbalance Learning

This report presents the work completed since the thesis proposal and the revised plan for the future PhD study. Two main issues have been discussed so far: diversity analysis of ensemble models in class imbalance learning, exploration of negative correlation learning on imbalanced data. Experimental design and main conclusions are simply described. More details are included in the two papers i...

متن کامل

One-shot and few-shot learning of word embeddings

Standard deep learning systems require thousands or millions of examples to learn a concept, and cannot integrate new concepts easily. By contrast, humans have an incredible ability to do one-shot or few-shot learning. For instance, from just hearing a word used in a sentence, humans can infer a great deal about it, by leveraging what the syntax and semantics of the surrounding words tells us. ...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: IEEE transactions on artificial intelligence

سال: 2023

ISSN: ['2691-4581']

DOI: https://doi.org/10.1109/tai.2023.3298303